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I. INTRODUCTION 

Kadanoff-Wilson’s 1 renormalization group 3], and the Kolmogorov-Sinai’s entropy 0] have one similarity: they 
involve a sequence of partitions of the underlying probability space respectively decreasing and increasing with respect 
to the coarse-graining ordering relation. 

In the introduction of [Jj one, indeed, reads that among the applications of renormalization-group there is the 
analysis of the onset of chaos in dynamical systems. 

Both therein and, as far as as I know, elsewhere, anyway (also taking into account M.J. Feigenbaum’s stuff i), a 
structural analysis concerning the inter-relation between Renormalization Group and the Kolmogorov-Sinai entropy 
is, at least as far as I know, still lacking. 

These brief notes are intended (to try) to make a (very little) step in such a direction. 


i 


As it often happens the attribution of paternity is a subtle matter. In particular a little dispute exists as to the contribution by C. Di 
Castro and G. Jona-Lasinio. As it is more appropriate in these cases one has to listen both the viewpoints □. Q 



3 


II. COARSE GRAINING FLOWS, REFINEMENTS’ FLOWS AND THEIR LIMIT POINTS 


Let ( X , cr, p) be a classical probability space and let us introduce the following: 

Definition II.1 

PARTITIONS OF (X,a,p): 

P(X, a, n) := {P = {Ai}™^ : n(P) G N+ , A t £ a i = 1, • • • , n(P), 

Ai n A 0 = 0 i,j = !,■•• ,n(P) :i^j, p(X - U n £ ] Af) = 0} (2.1) 


Remark II. 1 

Beside its abstract, mathematical formalization, the definition no has a precise operational meaning. 

Given the classical probability space (X, a , p) let us suppose to make an experiment on the probabilistic universe it 
describes using an instrument whose resolutive power is limited in that it is not able to distinguish events belonging 
to the same atom of a partition P = {Aj }” =1 G V(X, a, p). 

Consequentially the outcome of such an experiment will be a number 

rG{l,•••,«} (2.2) 

specifying the observed atom A r in our coarse-grained observation of (X, cr, /i). 

We will call such an experiment an operational observation of ( X , <r, p.) through the partition P or, more concisely, 
a P- experiment. 

The probabilistic structure of the operational observation of (X, cr, fi) through a partition P G V(X, cr, p ;) is enclosed 
in the following: 

Definition II.2 

PROBABILITY MEASURE OF THE P-EXPERIMENT: 

Mp := mU(p) 


where a(P) C a is the a- algebra generated by P. 

Given Pi, P 2 G V{X, cr, p): 

Definition II.3 

Pi is a coarse-graining P 2 (Pi < Pf)'- 

every atom of Pi is the finite union of atoms of P 2 


Definition II.4 

coarsest refinement of A= {Ai}" =1 and B = {Bj }™ =1 G V(X,a, p): 

A V B G V(X, cr, p) 

A V B := { Ai D Bj i = 1, • • • , n j = 1, • • ■ , m} 


One has that: 

Theorem II. 1 


< is an ordering relation over V(X, a, p) 


Let us now introduce the following: 


Definition II.5 
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ENTROPY OF P = G P(X, cr, ji): 


H(P) 


n(P) 

- ^2 Lip(Ai)\og 2 np(Ai) 


i=1 


(2.4) 


Remark II. 2 

The entropy H(P) of the partition P measures the amount of information that one acquires realizing the P-experiment. 

Definition II.6 

d : P(X, cr, /z) x P(X, a, ^) i—> [0, +oo): 

d(Pi,P 2 ) := |P(Pi)^P(P 2 )| (2.5) 

Remark II.3 

Let us observe that d is not a metric over V(X , cr, /z) since d(Pi, P 2 ) =0 =£> Pi = P 2 . 

Let us introduce the following: 

Definition II.7 

coarse-graining flow over (X, cr, fl) 
a sequence {P n }neN such that: 

P„ G P(X, cr, fl) and P n + i < P n Vn G N (2.6) 

Definition II.8 

refinements’ flow over (X, cr, /z): 
a sequence {P n }neN such that: 

P„ G P(X, cr, yz) and P n < P n + i V?z G N (2.7) 

Given an arbitrary sequence of mathematical objects {a n }„ S N let us introduce the following: 

Definition II.9 

reverse o/{a„} neN ; 

reverse({a„}„ eN ) = {P_„}„ eN : 6_ n := a n (2.8) 

One has clearly that: 

Proposition II.1 

1. {P„}n<EN is a coarse-graining flow =>■ reverse({P n } n £ n) is a refinements’ flow 

2. {P„}n<EN is a refinements’ flow =t- reuerse({P„ }„<=«) is a coarse-graining flow 

Given a refinements’ flow or a coarse-graining flow {P n JneN and a partition Po G P(X, cr, /z): 

Definition II.10 

P 0 IS A LIMIT POINT OF {P n }„ 6N : 

Ve > 0 , 3N G N : d(P n ,P 0 ) < eVn > N (2.9) 

Let us observe that: 

Proposition II.2 

1- {P n }neN is a refinements’ flow => H(P n ) < H(P n+ 1 ) Vn G N 
2. {P n }new is a coarse-graining flow => H(P n+ 1 ) < H(P n+ 1 ) Vn G N 
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III. KOLMOGOROV-SINAI ENTROPY VERSUS REFINEMENTS’ FLOWS 

Let us start from the following: 

Definition III.l 

classical dynamical system : 

a couple ((X, cr,//),T) such that: 

• (X, <7, p) is a classical probability space 

• T : X t—*■ X is such that: 


p o T -1 = p (3.1) 

Given a classical dynamical system CDS := ((X, er, //), T), the T _1 -invariance of p implies that the partitions 
P = {Ai}” =1 G P(X. cr, p) and T _1 P have equal probabilistic structure. Consequentially the P-experiment and the 
T _1 P-experiment are replicas, not necessarily independent, of the same experiment made at successive times. 

In the same way the T~ k P-experiment is the compound experiment consisting in n replications 

P , T _1 P, , ■ ■ • , T~A" _1 )p of the experiment corresponding to P 6 V(X, a , \x). 

The amount of classical information for replication we obtain in this compound experiment is clearly: 

\H(WlzlT~ k P) 

It may be proved (cfr. e.g. the second paragraph of the third chapter of Q) that when n grows this amount of 
classical information acquired for replication converges, so that the following quantity: 

h(P,T) := lim^oc i P(V^ T~ k P) (3.2) 


exists. 

In different words, we can say that h(P, T ) gives the asymptotic rate of production of classical information for 
replication of the P-experiment. 

Definition III.2 


hcDS '■= SUpp e -p(^x,a,iJ,) h(A, T ) 


(3.3) 


By definition we have clearly that: 


hcDS > 0 (3.4) 

Definition III.3 

CDS IS CHAOTIC: 

hcDS > 0 (3-5) 


By construction we have the following: 

Lemma III.l 

HP: 


PeP(X,a ;Ai ) 


TH: 
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{KzlT- k P} is a refinements ’ flow. 

from which it follows that: 

Theorem III.l 

HP: 


TH: 


P€V(X,c t,pl) 

{ V fe=oT ,_fc ^ > }raeN has a limit point 


h(P,T) = 0 
PROOF: 

If {V^~gT _fc P} rae N has a limit point, the rate of information gaining for replication of the P-experiment at a certain 
point tends to zero. ■ 
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IV. A BRIEF INTRODUCTION TO THE RENORMALIZATION GROUP 


Let us introduce briefly the Kadanoff-Wilson’s Renormalization Group in a simple setting 2 , for instance a system 
of spins Si = ±1 living on the sites of a D-dimensional finite cubic lattice (a{—N, —N + 1, • • • , 0, ■ • • , N — 1, N}) D 
and having dimensionless hamiltonian: 


H := 0H := -K 0 Y $ - K x ^ StS, - K 2 Y S * S i - K " Y S > S J - A -,i Y SiSjS k 

i <i,j> l <i,j>2 <i,j>n <i,j,k> 1 

- ^oo,2 SiSjSk - Koo^ ^ S l SjS k - 

<i,j,k> 2 <i,j,k> n 

2 S i S 3 S kSr - 


i^oo,oo,l ^ ^ SiSjSfcS r K 0 


<i,j,k,r> i 


<i,j,k,r> 2 


oo,oo,n ^ ^ SiSj SkS r • ■ • (4.1) 

<i,j,k,r> n 


(where /3 := ppp, kg being Boltzmann’s constant and T being the temperature) where < • • • > n denotes spins having 
distance n. 

Let us assume that the interaction decreases enough quickly at large distances so that the vector K of the coupling- 
constants belongs to the space foQR) := {{^nlngN : x n £ R, Yl^Lo \ x n \ 2 < +oo}. 

Let us now analyze how the dimensionless hamiltonian TL{ K) changes under a transformation which coarse-grains 
the short-distance degrees of freedoms. 

At this purpose let us divide the lattice (a{—N, —N + 1, • • • , 0, • • • ,N— 1 ,N}) D in cubic blocks of linear dimension 
la (with l -C N), the generic block B containing consequentially l D spins, and let us associate to each block B a block 
variable: 


S' B ■■= f({Si}ieB ) 


(4.2) 


with, for instance: 


mSihes) 


sign(J2ieB s i)> if s '*) ^ 0 ; 

Sq, otherwise. 


(4.3) 


Introduced the function: 


P{S',S} := n 5 Kronecker [Sb> /)] 


(4.4) 


the partition function of the system can then be expressed as: 

Zn( K) := Y exp(—7i(K), {S)}) = Zs{ K') := ^ exp(-?f (K 7 , {S^})) := 

ie(a{-N,-N+l,--- , 0 ,--- ,N-1,N}) D B 

Y ^P{S',5}exp(-H(K),{S i }) (4.5) 

ie(a{-N,-N+ 1,— ,(),••• ,N-1,N}) D B 

The pusscigG from ^_/y(IC) to Zn (K') corresponds to a map into the space Z 2 O&) of the coupling constants: 

K' = Ri( K) (4.6) 


called a renormalization of the coupling constants. 


2 The Renormalization Group applies to any model of Classical Statistical Mechanics and in particular to the situation in which the 
order-parameter lives on a space with cardinality greater than Kn; in this case one often speaks about ’’Statistical Field Theory” 

IH Since according to the Osterwalder-Schrader axiomatization [3 (or according to the less rigorous vulgata of Euclidean Field Theory 
|1G^ Quantum Field Theory reduces to Classical Statistical Mechanics (axiomatization affected by the irreducibility of noncommutative 
probability spaces to classical probability spaces and the related superiority of the Haag-Kastler axiomatization with respect to the 
Osterwalder-Schrader one) the application of the Kadanoff-Wilson Renormalization Group to Quantum Field Theory, resulting in the 
RG equation for the un-renormalized F n (where r(</>) = n\ f ^ Xl ' ’ ’ • • • , x n )(j)(x 1 ) • • • 4>(x n ) is the Legendre transform 

of the logarithm of the partition function), is nothing but a particular case of its general Statistical Mechanics’ framework. 



The renormalizations of the coupling constants form a semigroup: 


iWK) = Rp (K) • Ri 2 (K) 


(4.7) 


usually called the renormalization group. 

Adhering to the usual terminology we will will also refer to a renormalization of the coupling constants as to a 
renormalization group transformation. 

Iterating a transformation Ri one performs a discrete-time dynamics in the coupling-constants’ space I 2 (R) to which 
the whole conceptual apparatus of Classical Dynamical Systems’ Theory applies (such as the theory of fixed-points 
and their basins of attraction): 
given K* £ l 2 ( R): 

Definition IV. 1 

K* is a fixed point of the renormalization-group transformation Rp. 

Ri{ K*) = K* 

Given a fixed point K* of the renormalization-group transformation Ri: 

Definition IV.2 3 

basin of attraction of K* with respect to Ri: 

Bj(K*) := {KeZ 2 (R) : lim Rf( K) = K*} 

n —>-+oo 

where Kf denotes the n -iterate of Ri. 

Remark IV. 1 

Since each renormalization group transformation Ri corresponds to a reduction of the number of degrees of freedom 
of a factor l D one could think that a renormalization group flow necessarily terminates with the elimination of all the 
degrees of freedom. 

Taking the thermodynamic limit N —> +00 it follows that an infinite number of iterations of a renormalization 
group transformation Ri is required in order to eliminate all the degrees of freedom. 

It is only under the thermodynamical limit that singularities in the free-energy F := — ^ log Z or its derivatives can 
occur. 

Remark IV. 2 

According to Ehrenfest’s classification a critical point of n th order is a point on which the free-energy is differentiable 
n — I times, but not n times. Following the usual terminology [7] we will call a transition of second order any critical 
point of Ehrenfest-ordering greater or equal than two. The phenomenon of Universality of the long-distance behavior 
in the phase transitions of second order is owed to the fact that different physical systems correspond to different 
points of a same basin of attraction £>;(K*). Such a basin of attraction is then also called a universality class. 


3 Introduced the following inner product over I 2 (M): 

OO 

({^nJnGN) {?/n}nGN) := ^ ^ %nUn (4.8) 

n=0 

one has that (^(R), (•, •)) hi an Hilbert space over R so that the norm ||{#n}neN|| := \/({^n}n€N) {#n}neM.) induces the metric 
d({ x n}neNi {l/n}neN) := ||{^n}nGN — {2/n}n£Nll than can be used to define the notion of limit in the usual way llll . 
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V. RENORMALIZATION GROUP AS A PARTICULAR KIND OF COARSE-GRAINING FLOW 

Let us consider the classical probability space ((a{—N, —TV + 1, • • • , 0, • • • , TV — 1, N}) D , Bsorei, where: 
dK{ s i}i<fla{-N,-N+i,-,o,-,N-i,N})°) ■= Nexp[-H(K, {Si})] 6(Sf - l)dSi ( 5 . 1 ) 

ie(a{-N,-N+l,--- ,0, — ,N-1,N}) D 

where N is a normalization constant. 

The coarse-graining underlying the renormalization group transfoi'mation Ri may be represented by the parti¬ 
tion P G V((a{—N , —TV + 1, ■ ■ • ,0, • • • , TV — 1, TV}) 15 , BsoreU p) whose atoms are the different blocks B by which 
(a{—TV, —TV + 1, ■ • • , 0, ■ • • , TV — 1, TV}) 15 has been divided. 

The iteration of Ri corresponds to a coarse-graining flow {PrP}neN over the classical probability space 
((a{— TV, — TV+1, ■ • • , 0, • • • , TV— 1, TV}) 15 , Bsorei, fl) to which corresponds the flow of probability measures {p p (i)} n eN- 
Let us now suppose that the initial condition K of the renormalization group flow belongs to the the basin of 
attraction Bfl K*) of a fixed point K*. 

It follows that the coarse-graining flow {Pn 1 } n eN has a limit point (according to the definition lll.lQIl . 

Let us now introduce: 


{P-l}ne n := reverse{{P^} nen ) 


(5.2) 


By Proposition QTT] {P^l,} is a refinements’ flow. 

Let us now consider a //-preserving map 7] : ((a{— TV, — TV + 1, , 0, - • • , TV — 1,1V}) 15 i —> ((a{— TV, —TV + 

1, ■ • ■ , 0, • • ■ , TV — 1, TV}) 15 such that: 

v n-i T -fcp o (0 = p(0 Vn G N (5.3) 

If our knowledge of the renormalization group flow allowed us to know that also {P-lfinen has a limit point we could 
use theoren fTTT.1 I to infer that: 

Ti(P o W ,T0 = 0 (5.4) 


Example V.l 

Let us consider the simplest possibility, i.e. the one dimensional Ising model corresponding to the assumptions that 
the only coupling constants different from zero are Kq and K\ and, obviously, that D = 1. 

Let us impose periodic boundary conditions Sn +i := S\ 

The N-spin partition function can be written as: 


where T is the transfer matrix: 


T := 


Z 


N = TrT N = (5.5) 

exp(A' 0 + AT) exp(-AT) \ ( , 

exp(-Ad) exp(A' 0 — Kfl) ) 1 


and where X± are its eigenvalues: 

A± = exp(A"i)[cosh(A' 0 ) ± \J sinh 2 (A' 0 ) + exp(—4 Ad)] 


(5.7) 


Let us consider as blocks couples of nearest neighbors spins. One has that: 

Zn( K') = TrT’% 

2 


(5.8) 


where clearly: 


T' 


_ ^2 


(5.9) 
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Let us impose that, up to a multiplicative constant, T' has the same form as T: 

T ' = r ( e M K o + K 'i) exp (~K[) 

V exp(-A^) exp(Ag - K[) 

It is useful 0 to parametrize the coupling-constants’s space introducing the vector: 

V := (Vb.Vi) 

where: 

Vi := exp (-Ki) i = 0,1 

The renormalization group transformation K 7 = I? 2 (K) induces an analogous map V' = R. 2 (V) where: 

V' := (Vo, Vi) 


V' := exp (—A'-) i = 0,1 

The map P 2 , obtained comparing eo 15.91 with ea 15.101 is explicitly given by: 

(V 4 + v 0 2 ^ 


' (V 4 + ^)i 


v , = + 

1 {v 4 + ^ + v 2 + ^ 


(5.10) 

(5.11) 

(5.12) 

(5.13) 

(5.14) 

(5.15) 

(5.16) 


c - (F ° + Vo ^^ 4 + V* + v ° 2 + v t ? )5 (5 ’ 17) 

(n\ 

Let us now construct the coarse-graining flow (P„ ; } ra eN- 
One has clearly that: 

P 0 (2) = {{—aN, —a(N + 1)}, {—a(77 + 2), —a(N + 3)}, {—a(N + 4), —a(77 + 5)}, 

{-a(N + 6), —a(N + 7)}, • • • , {a(77 - 7), a(77 - 6)}, {a(77 - 5), a(N - 4)}, {a(N - 3), a(N - 2)}, {a(N - 1), aN} 

(5.18) 


P[ 2) = {{- aN, —a(N + 1), -a(77 + 2), —a(N + 3)}, {-a(77 + 4), - a(N + 5), -a(77 + 6), -a(N + 7)}, 

• • • , {a(N - 7), a(N - 6), a(N - 5), a(N - 4)}, {a(77 - 3), a(77 - 2 ),a{N - 1), aN}} (5.19) 


P 2 (2) = {{-aN, -a{N + 1), -a(N + 2), -a{N + 3), -a(N + 4), -a(N + 5), -a{N + 6), -a(N + 7)}, 

• • • , {a(N - 7),a{N - 6), a(77 - 5 ),a{N - 4),a(N - 3),a(N - 2),a(N - 1), aN}} (5.20) 

and so on. 

Introduced the refinements’ flow: 

:= reuerse({P^ 2) }„ eN ) (5.21) 

let us suppose to have a /z-preserving map T 2 : a{—N, —N + l, ■ • • , 0, • ■ • , AT — 1, N} a{—N, —77+1, • • ■ , 0, • ■ ■ ,77 — 
1, AT} such that: 

V”Z o 1 T- fc P o (0 = P® Vn G N (5.22) 

Let us now analyze the structure of the renormormalization group flow: 

performing in inverted sense the basin of attraction of any fixed point := (A, 1), A G (0,1) one sees that it is a 
sequence converging to V, := (1,0). 

So it follows that the associated refinements’ flow {P-h} n e N ^ as a limit point. 

Hence, by theoren flII.il we can infer that: 

MPW,^) = 0 


(5.23) 
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